Rumor says that peasants were sacrificed to a daedra cult, and was later take over by the Imperial Army.
Eventually it fell into ruin, but was eventually re-inhabited by the Dowager Queen.